System and method for verifying viewing of multimedia rendering of investigator meeting prefatory to clinical trial participation

ABSTRACT

A system and method providing passive verification of participant—typically a physician—exposure to Material equivalent to attendance at an Investigator Meeting prefatory to Clinical Trial is taught. The invention provides for rendering media capture of Investigator Meeting education into computer deliverable sessions, and further into segments, where segments are the product of randomly generated visual requests to which participant need provide response in some prescribed time interval to confirm visual attention to Material. To ensure participant visual exposure to Material, during computer mediated display of Material, visual prompts appear at random points in the display. For any successful participant response, session advances, and in absence of successful response, display of Material resets to last successful response point in Material. In an alternate embodiment, groups of viewers may be tracked corresponding to a group viewing of Material. The system provides real-time tracking of completion of visual exposure to Investigator Meeting Material and enables Clinical Trial sponsor to dynamically update enrolled participant data, and actively encourage physician completion of Investigator Meeting equivalent attendance, so as to expedite Clinical Trial launch.

RELATED APPLICATIONS

This application claims priority from U.S. provisional application60/903,662 by the same inventors, filed Feb. 27, 2007 and which isincorporated by reference in its entirety.

FIELD OF USE

This invention relates to computer based learning delivery systems andmore specifically concerns a means to verify viewer compliance withviewing requirements. In a specific embodiment, the invention relates tophysicians (“investigators”) complying with requirements to participateas investigators in clinical trials.

BACKGROUND

Computer based learning delivery systems have been in existence almostsince the availability of computers and related network technologies.Computerized learning delivery systems have progressed to a point where,in conjunction with advances in network and telecommunicationstechnology, online distance learning is practical. The Internet has madeit possible to deliver rich multimedia training material that containsvideo, text, and graphics to viewers who are widely geographicallydispersed. Online systems can deliver powerful, effective trainingmaterials to many viewers at virtually any location, at any time. Thisallows the expertise of teachers and/or “knowledge experts” to becaptured once and delivered many times to virtually unlimited numbers ofviewers at their convenience.

Government, corporations and educational institutions have implementedlearning and/or training programs over the Internet. Many types ofnetwork or Internet on-line training are now possible using thistechnology. Training of this sort includes professional education wherethe professional must complete some required number of hours of trainingin the specified area of learning. However, an obvious problem withonline learning delivery systems is a means of verifying that the viewerhas actually watched all of the materials in the prescribed curriculum.A viewer may simply elect to not watch the training at all or may simplystart the training and allow the training to automatically progresswhile they are otherwise occupied or physically away from the computeror terminal where the training is being delivered. In either case, theviewer has avoided meeting the basic requirement that they actuallywatch all of the training materials. It should be noted that therequirement to watch the training material is separate and distinct fromthe need to ensure that the viewer demonstrates retained knowledge andunderstanding of the materials presented.

Because it is difficult to verify that a viewer has actually viewed allof the required materials, many companies, governments, or regulatoryauthorities have simply not permitted distance training to be used forsome forms of training. Without the ability to verify that the viewerhas in fact viewed all of the required material, it is impossible toensure that the viewer has met the minimum requirements for thetraining. What is needed is a means to verify viewer compliance withviewing requirements associated with on-line or network mediatedtraining.

U.S. Pat. No. 6,928,260, Betz, et al (“Betz”) allows for bidirectionalcommunication between the educator and the viewer using an audiocontrolling mechanism. The viewer is not permitted to advance during thetime that the audio file is “played” by the plug-in and/or browser. Asthe rate of advancement of the educational material presented to theviewer is controlled by the system, the system insures that the viewer“attends” the course for a minimum period of time. The system preventsthe viewer from skipping, or fast forwarding the material. Practicallyspeaking, Betz only teaches a system to control the pace and advancementof the training, and permits confirmation the materials were played or“delivered” to a User's computing device. However, the Betz system andmethod does not ensure that the User/viewer is, in fact, actuallylistening to or viewing the training materials that are being“delivered.”

It is useful to consider the invention in the preferred embodiment:verifying that physicians intending to be “investigators’ in a clinicaltrial view a recording (audio visual presentation) of the InvestigatorMeeting if they did not attend the live event. Each and every physicianin a clinical trial must receive the protocol instructions and relatedinformation, and the protocol instructions are taught and discussed atan Investigator Meeting. A trial launch could be delayed if insufficientnumbers of physicians had attended an Investigator Meeting. Thus itbecame increasingly important to duplicate the substantive experience ofexposure to the material presented at the live event (Investigatormeeting).

It can be appreciated that the physicians who elect to view the recordedInvestigator Meeting rather than attend the live event are subjected tono tests, nor are the physicians who elect to attend the live event.

What is needed is means to ensure that a viewer is attending to themedia, including circumstances in which media is delivered over anetwork, including the World Wide Web or the Internet. What is furtherneeded is a means to track partial completion of required viewing, andpresentation of any remaining materials to be viewed, so that viewer isreliably tracked, and compliance documented.

SUMMARY

The present invention meets at least all of the recited needs. Theinvention taught herein provides a system and method to ensure that theviewer is actually present and watching the materials, the media oraudio visual content, by requiring successful input from the viewer atrandom intervals during the presentation of the training material insuch a manner as to confirm that they are actually at the computer orterminal and are actively viewing the materials. The system requiresviewer input to occur within a pre-set period of time after the prompt.

In the event that the viewer fails to successfully perform the requiredinput within the provided time period, the system will pause thetraining and wait for the viewer to return. Once the viewer resumestheir training, the system restarts the training at the time point ofthe last successful data input (or the beginning of the training if noinput has been required up to that point) and requires the viewer towatch the training from that point again.

In addition to requiring random input from the viewer, the systemautomatically keeps track of all of the material that has been presentedto ensure that all of the training material has actually been viewedbefore certifying that they have completed the training segment.

Each time a viewer initiates a training session, the systemauthenticates that the person signing in is in fact the person who isrequired to take the training.

By tracking the material that has been presented to a viewer andrequiring the authenticated viewer to enter input at random intervalsduring the presentation, the system forces the viewer to be present atthe computer and ensures that all of the training materials have beenwatched. If the viewer fails to enter the required input within therequired amount of time, the System requires the viewer to re-watch thepresentation from the time of the last successful input.

The System is comprised of the Server, the Launcher, and the Player. TheServer is the system that contains the database and all of the dataneeded to support the launcher and the player (see below). The serveralso contains all of the code that supports the launcher and the player.

The Launcher is a page where all of the Topics and Presentations thatmake up a meeting (or event) are organized and presented to the user. Itis primarily an organized view of the meeting or event content in alogical order and allows the user to navigate. The Launcher is where theuser can see which segments they have viewed and which segments comenext. The launcher also allows the user to view their total progressthrough the training and allows them to print out a Certificate ofCompletion once they have viewed all of the materials. The Launcheropens the Player when the user selects a segment to view. The Launcheralso allows a user to view other supporting materials e.g. PDFdocuments, non-certified training in the form of multimedia basedplayers, etc.

The Player is a custom program built using HTML, JavaScript andActionScript. The Player embeds Adobe (Macromedia) Flash objects thatdisplay the Video and PowerPoint Slides or other graphics. The Playercontains all of the Watch Code functionality and code; logic to view,advance, or replay “sections” within a segment; and logic to launch thenext segment (without having to go back to the launcher page). ThePlayer tracks the users progress through the segments/sections andreports it back to the Server.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts, by means of a flow chart, a system and method accordingto the preferred embodiment.

FIG. 2 is a screen shot illustrating a presentation screen according tothe preferred embodiment.

FIG. 3 is a screen shot illustrating Watch Code screen shot according tothe preferred embodiment.

FIG. 4 is a screen shot illustrating a screen shot after successfulentry of Watch Code according to the preferred embodiment.

FIG. 5 is a screen shot illustrating a screen shot after failure toenter Watch Code according to the preferred embodiment.

FIG. 6 is a screen shot illustrating a return to a presentation pointafter the last successful Watch Code entry according to the preferredembodiment.

FIG. 7 is a screen shot according to the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

A system and method according to the present invention is describedherein below and can be appreciated by reference to the accompanyingdrawings. Certain aspects may be commonly appreciated, and require nodetailed discussion. For example, in order for a computer mediatedtraining system to function, there must be a computing device and CPUelement, and connection of the computing device to a network.

The System is comprised of the Server, the Launcher, and the Player. TheServer is the system that contains the database and all of the dataneeded to support the launcher and the player (see below). The serveralso contains all of the code that supports the launcher and the player.

The Launcher is a page where all of the Topics and Presentations thatmake up a meeting (or event) are organized and presented to the user. Itis primarily an organized view of the meeting or event content in alogical order and allows the user to navigate. The Launcher is where theuser can see which segments they have viewed and which segments comenext. The launcher also allows the user to view their total progressthrough the training and allows them to print out a Certificate ofCompletion once they have viewed all of the materials. The Launcheropens the Player when the user selects a segment to view. The Launcheralso allows a user to view other supporting materials e.g. PDFdocuments, non-certified training in the form of multimedia basedplayers, etc.

The Player is a custom program built using HTML, JavaScript andActionScript. The Player embeds Adobe (Macromedia) Flash objects thatdisplay the Video and PowerPoint Slides or other graphics. The Playercontains all of the Watch Code functionality and code; logic to view,advance, or replay “sections” within a segment; and logic to launch thenext segment (without having to go back to the launcher page). ThePlayer tracks the users progress through the segments/sections andreports it back to the Server.

The system also logically includes one or more display means for aViewer or User to view the audio-visual training (also referred toherein as media, or media training). The invention taught hereinprovides a means for verifying that media training has been viewed.

FIG. 1 is a diagram of the invention, describing the logical sequencesupporting verification that an on-line media training has been viewed.Applicants refer to the inventive system in the preferred embodiments ashaving a “Watch Code” or “Watch Code Logic.” As can be appreciated byreference to FIG. 1, a User or viewer commences on-line media trainingand the inventive system ultimately records that the User has completedthe viewing of the media training As can be appreciated by reference toFIG. 1, the system of the invention taught herein begins with a User(also referred to herein as “viewer”) commences a selected mediatraining for on line training, and ends when the System has recordedthat User has completed the media training.

The steps are as follows:

Viewer/User starts online training 20; this includes logging in to thesystem, providing user id information, according to the protocol designof the embodiment. In the preferred embodiment, the Viewer would be aphysician required to complete the viewing of a recorded InvestigatorMeeting. As part of the preparation of the curriculum, the recording,which may total twenty or more hours of presentation, has been organizedinto logical portions or segments. From the User log-in, the system willtrack the segments successfully completed by the Viewer by means of thesuccessful Watch Code Entry history. At some random time interval 22, aWatchCode is randomly generated 24 and the time point recorded. In thepreferred embodiment, a WatchCode is a four digit number that appears onthe screen. The WatchCode remains in the screen for a predeterminedcapture period 25, during which time the Viewer must type in the code.In the preferred embodiment, the capture period is 60 seconds. Duringthe capture period, the content continues to play so long as theWatchCode is on the Screen (see FIG. 3). User action 26 serves to add anadditional 60 seconds to the counter. If, as depicted in FIG. 5, theUser fails to enter the Watch Code in the allotted time 28, the system,records the Watch Code as “missed” 30, displays a message to user andpauses the content 32. In the preferred embodiment, the user must clickto continue, and the system will re-start, when the user clicks, at thelast successfully entered Watch Code 34.

As depicted in FIG. 4, when a User enters Watch Code 36 the systemchecks if the number entered matches the code appearing on the screen38. If incorrect, an error message appears, and User is asked tore-enter the Watch Code. If the code entered is correct 42, (see alsoFIG. 6), then the System records the successful Watch Code Time Point44; if the entire current segment has not been viewed 46, if unviewedsegments remain, return to step 22. If the entire segment has beenviewed, the System records that the user has successfully completed thesegment 48. The system checks: Are there more training segments 50? Ifyes, then Next segment begins 52; if no more training segment remainunviewed 54, then the system records the User has completed thetraining.

For any material to which the invention may be applied, an onlinetraining curriculum is created and defined. The audio and/or video andaccompanying text and graphics are created. One or more trainingsegments are defined for the curriculum. In the preferred embodiment,the training curriculum is the media recordation of an Investigatormeeting, prefatory to a clinical trial. After audio-visual recordationof the Investigator meeting, text and graphic are Prepared, synchronizedand integrated into the online training session.

In the preferred embodiment, where delivery of the training material viathe Internet is desired, the completed and formatted training materialsare made available on-line. Once the material to be viewed is available,a viewer who is enrolled or otherwise registered for the on-linetraining logs in, is identified according to log-in information, andthen may access the system to deliver the training via a network or theInternet.

In the preferred embodiment, the viewer starts training, after averringto be the person to whom the login information has been provided. Thesystem starts playing the audio, and/or video for the training segmentin the curriculum and displays any text or graphics that accompany theaudio, and/or video. An exemplar of a screen shot representative of anon-line audio-visual training video is provided in FIG. 2. The systemstarts the training at the beginning of the first training segmentunless the viewer has started the training previously, in which case thesystem restarts the training at the time point in the training segmentwhere the previous viewing session ended.

After commencement of the training and at random intervals, the systemgenerates and displays and a random code and requires the viewer toenter the displayed code within a configurable, set period of time (e.g.60 seconds). The audio and/or video does not pause or stop during thetime that the code to be entered is displayed on the screen.

When the viewer successfully enters the displayed code, the systemrecords the time point of the successful entry and continues to play theaudio and/or video and display all accompanying text and graphics.

If the viewer fails to enter the displayed code (“Watch Code”) withinthe available period of time for whatever reason (i.e. because theviewer is not paying attention or is not physically at the computer orterminal), the system pauses the audio and/or video playback and waitsfor the viewer to return and elect to continue the training. Upon theviewer electing, by means of a keystroke, to continue the training, thesystem takes the viewer back to the time point where the last successfulcode entry occurred, requires them to re-watch the training from thatpoint, and forward through random additional Watch Codes.

In the event that the viewer closes the browser or application withoutelecting to continue, the system persists the last successfully entereddisplay code time point. When training is resumed, the system restartsthe training at that point.

When the system determines that the viewer has successfully watched allof the material for the current training segment, the system allows theviewer to proceed to the next training segment. In the event that theviewer wishes to re-review a successfully completed segment, the systemdoes not generate or display random codes since the viewer has alreadybeen verified as having watched the entire training segment.

Once the viewer has completed watching all of the materials in all ofthe training segments, the system records the fact that the viewer hassuccessfully completed the training. Advantages of the inventive systemand method include, but are not limited to the following. The systemdoes not require any administrator or teacher interaction during thetraining or require anything to be created beyond the trainingmaterials. The system does not provide any audible queues to a viewerwho is not sitting at the computer and paying attention that the displaycode requires data entry. This prevents a viewer from simply startingthe training and walking away while the training materials play. It alsoprevents the viewer from minimizing or hiding the training materialwhile they perform other tasks on the computer or terminal.

The system actively tracks and records the watched portions of thetraining materials, ensuring that 100% of the training materials havebeen viewed. The system provides full audit/reporting capabilities aboutthe progress for each individual viewer and allows detailed analysis oftheir progress through the training. The system allows a viewer tocomplete the viewing of the training materials over any number ofviewing sessions, tracking automatically portions viewed, relievingviewer of personally tracking or recalling viewing history.

The system decouples the watching/viewing of training materials from theverification that the viewer has retained knowledge or can demonstrateproficiency in the area of training. This follows the traditional “learnthen test” model. The system facilitates viewers procession through thetraining in a prescribed sequence. This ensures the tracking andrecording of the satisfaction of pre-requisites, such as verifiedviewing of prepared audio-visual material. The system can allow a viewerto view the materials comprising a media package or program in anyorder, and confirm or verify that the viewer has watched all of thematerials in the media package.

Alternate embodiments of the inventive system and method include, butare not limited to embodiments recited herein below.

The system can be offered in a stand-alone system where the trainingmaterials are distributed on physical media and not through the networkor Internet. Instead of requiring data entry of a randomly generatedcode, the system can require a biometric input such as fingerprint,facial recognition, etc. through the use of a biometric hardware dongleor embedded biometric data acquisition device. The viewer can berequired to submit their biometric profile at the beginning of thesession and then be required to revalidate that biometric input atrandom intervals throughout the session.

A group of viewers can be created and watch the training as a groupwhile the system tracks each viewer individually for completion status.In this implementation, each viewer in the group is required to “signin,” authenticating that each viewer is present, each time that trainingis conducted.

18. A computer-mediated media delivery and session viewing verificationsystem optimized for physician compliance with requirements forparticipation as an Investigator in at least one clinical trial, saidSystem including: the content of the Investigator Meeting associatedwith said clinical trial, where said content includes InvestigatorMeeting topics and presentations, and where said Investigator Meetingmay be in progress such that said content is dynamically acquired, andwhere physician attendance at said Investigator Meeting prefatory toclinical trail participation may be satisfied by exposure to amultimedia rendering of said Investigator Meeting; a Server, said Servercontaining video and/or audio of said Investigator Meeting content, saidServer also containing a database, and code to support Launcher andPlayer, said Server tracking and recording said physician compliancewith requirements for participation as an Investigator in said clinicaltrial, and further providing full auditing and reporting of the progressof each physician, enabling detailed analysis of said progress; aLauncher, said Launcher providing a navigable means for physician toview and select Investigator Meeting topics and presentations, wheresaid selection is identified as a selected session, and including, forany selected session, accompanying session-related Investigator Meetingmaterials in a variety of forms; a Player, said Player comprised ofcomputer implementable instructions, said instructions includingproviding a controllable means to display Investigator Meetingmaterials, and providing Watch Code functionality and logic, said WatchCode providing a means wherein during the computer-mediated mediasession delivery of a selected session, random prompts occur forphysician input at random intervals during the selected session, suchthat if said input is successful, said selected session continues, andif said input is unsuccessful, said selected session re-sets to the lastpreviously successful input, where such re-set is without recourse tothe Launcher so that any number of interruptions may occur in the courseof a selected session and said System automatically keeps track, aidingphysician in the completion of said selected session, and storing thecompletion data in said Server thereby overcoming delays in ClinicalTrial commencement attributable to insufficient numbers of physiciansattending an Investigator Meeting.
 19. A system as in claim 18, whereina pre-determined sequence of selected sessions is imposed such that saidphysician obtains full navigation ability after the completion of saidpre-determined sequence.
 20. A system as in claim 18 wherein, in theevent of logout during a selected session, said Launcher appears at thenext login, and automatically returns to the session containing the lastsuccessful WatchCode entry.
 21. The system as in claim 18, wherein saidinput is randomly prompted and input type includes any of: data entry;biometric data, said biometric data including any of a facialrecognition scan, a voice print, a fingerprint, or a retinal scan.